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Abstract 

In this paper, we investigate two-parameter entropies and obtain some 
conditions for their extensivity. By using a generalized (k, r) — product, 
correlations for subsystems are related to the joint probabilities, so that the 
entropy remains extensive. 
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1 Introduction 



A quantity X(A) associated with a system A is said additive with regard to 
a specific composition of A and B if it satisfies 

X{A + B) =X(A)+X(B) (1) 

where + inside the argument of X precisely indicates that composition, 
suppose, instead of two subsystems A and B, we have N of them 
(Ax, A 2 , ...,A N ). Then the quantity X is additive if we have 

n n 

= (2) 
1=1 1=1 

supposing that all subsystems are equal, 

X(N) = NX(1) (3) 

with the notation X(N) = X(Y™ =1 M) and X(l) = X(A 1 ). Another related 
concept is extensivity which corresponds to a weaker demand, namely that 

Inn M <[0 (4) 

N^oo N 

Clearly, all quantities which are additive, are also extensive, whereas the 
opposite is not necessarily true. In other words, extensivity is defined as 
additivity when N — > oo. Of course, there are quantities that are neither 
additive nor extensive. They are called nonextensive . Boltzmann-Gibbs 
(BG) statistical mechanics is based on the entropy 

w 

S B g = -k^pdnpi (5) 

i=i 

with 

w 

Eft = 1 ( 6 ) 

i=i 

where Pi is the probability associated with the i th microscopic state of the 
system and k is Boltzmann constant. From now on, and without loss of 
generality, we shall take k equal to unity. 
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Nonextesive statistical mechanics, first introduced by C. Tsallis in 1988 
[UI21E], is based on the so-called 'nonextensive' entropy S q defined as follows: 



1 _ V 117 rfl 

bq= q-1 [V 

As we see this entropy depends on parameter q. Afterwards, some other 
entropies were suggested depending on one parameter jU Hj • 
Recently, an entropy was introduced jHl El that depends on two parameters, 
and in some special limits recovers other entropies that had been introduced 
previously. That is 

w 

S k ,r = -J2P^ U k,rPi (8) 
i=l 

with 

ln ktr (x) = x r — (9) 

The concept of extensivity has been investigated mostly for systems with 
no correlation, namely independent systems. In that case, the probabilities 
belong to the composition system are defined as the product of the 
probabilities in each subsystem. If the composition law is not explicitly 
indicated, it is tacitly assumed that systems are statistically independent. In 
that case, for two systems A and B, it immediately follows that 

S BG (A + B) = S BG (A) + S BG (B) (10) 

hence, BG-entropy is additive and also extensive, but for q-entropy we have 

S q (A + B) = S q (A) + S q (B) + (1 - q)S q {A)S q (B) (11) 

hence, q-entropy is nonextensive for q ^ 1. In 10J Tsallis has illustrated 
the remarkable changes that occur when A and B are specially correlated. 
Indeed, he has shown that in such case 

S q (A + B) = S q (A) + S q (B) (12) 

for the appropriate value of q (hence extensive), whereas 

S BG (A + B)^ S BG (A) + S BG (B) (13) 
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hence BG-entropy isn't extensive in the case of correlated systems |14j . 
This paper is organized as follows. In sec. 2, the nonextensivity of S k , r 
is discussed, where the extensivity of BG-entropy is recovered in an special 
limit. In sec. 3, we investigate how to interpret entropy Sk, r extensive and 
finally in sec. 4 extensivity of entropy with canonic ensemble is discussed 
when we have correlated subsystems. 

2 nonextensivity of Sk, r m the case of 
independent systems 

As said, the entropy S k} r Eqs. (jEJ) and (JOJ) is more general than the other 
entropies introduced previously and in some special limits recovers them. We 
prove that this entropy is nonextensive in the case of independent subsystems. 
Supposing two independent subsystems A and B, for the probability in the 
composite system A + B we have 

pt B =Pfpf V (^') (14) 

with the definitions 

W A 

S fc)r (A) = -£pfln feir pf (15) 

i=i 

W A W b 

S Kr {A + B) = - £ Y,vft B ^rPft B (16) 

i=l j=l 

By adding and subtracting the phrase p\ +k+1 p r f k+1 and using Eq. @, we 
can find 

W B W a 

S k , r (A + B) = J2p r f k+1 S k ,r( A ) + E^ +1 ^(S) (17) 

3=1 i=l 

As we see 

S k , r (A + B)^3 h , r {A)+S ktr {B) (18) 

hence S k , r isn't extensive in general. However, one may choose some special 
range of parameters where Eq. (fTTj) is extensive. We study the extensivity 
of Sk,r in some special limits. 
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2.1 q-entropy(Tsallis entropy) 

The q-logarithm that is usually used is 



x l ~i — 1 



With this logarithm the q-entropy is defined as 



w 

S q (p) = -J2plHPi (20) 

i=l 



by choosing r = k and q = 1 + 2k in Eqs. (JHJ) and ([§]). one has 

w 

s q { P ) = ( 21 ) 



where 

M*) = — (22) 

g- 1 

which gives an equivalent entropy to Eq. (|2U|1. For exp g (x) it is obtained 

exp ? (» = [l + (g- (23) 
In the limit r = k and q — 1 + 2k from Eq. (fT7j) . one recovers 

S,(A + 5) = E pA(A) + E^,(5) = S g (A) + 5,(5) + (1 - g )5,(A)5,(5) 

j=l i=l 

(24) 

that is the familiar expression for nonextensivity of q-entropy. In the limit 
q — > 1 extensivity of BG-entropy is obtained. 

2.2 k- entropy 

The k-entropy introduced in [SI Ej is 

w 

Skip) = ~^2vMkPi (25) 
i=i 
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where 



W(x) = 2k (26) 

It is clear that we can recover k-logarithm from Eq. in the limit r — > 0. 

For exp fc (x) we have 

exp fc (a;) = (Vl + k 2 x 2 + kx)^ (27) 

In that limit Eq. (fT7|) results in 

w B w A 
S k (A + B) = Y,Pj k+1 S k (A) + J2p- +1 S k (B) 

3=1 i=l 

± S k (A) + S k (B) (28) 

that ensures the nonextnsivity of the k-entropy. It is clear that in the limit 
k — > the extensivity of BG-entropy is obtained again. 

3 How to interpret the entropy Sk, r extensive 

Suppose, we have N subsystems (A 1 , A 2 , A N ). We define the probabilities 
in the composite system p A \^. A i^"' +AN that satisfy the condition 



^i+A 2 + ...+A 

1 

and marginal probabilities as follows 

As — ^2 ,,.tj + .i-..+...+.i 

iii2...i s -ii 3 +iiN 

If Pir£...iw "' +An also satisfies the condition 



E pt£X~ +A " = 1 ( 2 9) 



p?;= E pi£X~ +AN (so) 



^™ + - + " = ex Pfc , r ( E KrPfr) (31) 

s=l 

then for the entropy of the composite system with the definition 

E pt^X- +AN ^pt^X- +AN (32) 

s=l iii2...ijv 

6 



we have 



N N 

s k , r (T, A s) = - E ^ 2 + .t + --- +Ajv Kr[ex Pfc , r (EK,p^)] 

s=l ixi2—iff 8=1 

N 

= _ V" v Ai+A2+ - +An Vim. v As 

il«2...«jv 8=1 

JV /V 

= - E E^ s KrPfr = E W ( 33 ) 

s=l i 3 s=l 

It is useful at this point to connect the present problem to some generalized 
algebra which have been discussed by many authors. We use the product 
introduced in 0. It is defined as follows: 

x y = expk,r ( ^k,r{ x ) + ln h , r (y)) (34) 
hence we can write (j3~Tj) as 

N 

A 1 +A 2 +...+A N _ /V^i^ m A s \ 



A!+A 2 +...+A N _ fVln, n J 

Phi 2 ...i N — eX Pk,A m k,rPi 



= p£ 1 ®k,rPi 2 ® k , r ---®k,rPi N (35) 

So extensivity of the entropy is satisfied if we use logarithm, exponential and 
also the product based on (|34|). In the limit k — > and r — > (BG-limit), the 
usual product is recovered and (|33j) describes the probability of composite 
system in the case of independent subsystems and also extensivity of BG- 
entropy in that case which is expected. Eq. (J31|) is a very special correlation 
for subsystems which leads to extensivity of entropy, however, it is possible 
to define a general correlation among subsystems so that the entropy remains 
extensive. Consider the following relation 

p£t A C'" +AN = Ph Al ®k,rp£ 2 ®k,r ■ ■ ■ ®k,r P t (36) 

where p Aa s are the probabilities of each subsystem, but Pi 1 \t...iN ''' + Ns are 
not necessarily represent the joint probabilities. Now the sum of subsystem 
entropies can be written as 

N N N 

E s k ,Ms) = -J2Y.pt k*,rp£ = - E pf£X + ~ +AN E Kr j£ 

s=l s=l i s i\i2...ifj s=l 
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E Phi 



A!+A 2 +...+A r 



N 



2-..IJV 



lnfc,r[exp fc (5^1njfe, r p^)] 



= - E pfi 

«li 2 ...ijv 

So entropy is extensive if 



5=1 



2-..IJV 



l n , n 1 



12...1JV 



(37) 



AT 
s=l 



E ll+Aj+...+4 i A! 
Pi 1 i 2 ...i N lll k,r Pi 1 i 2 ...t N 



Ai+A 2 +...+Aj. 



ll« 2 ...ljV 



2— IN 

iiin... inr 



12—tN 



(38) 



It is clear that Pi^.f^''" + N and pf^^i^'" +AN can be related to each other 
by the following relations 

E A 1 +A 2 + ...+A N/ 
Pi\ii...i 



~Ai+A 2 +...+An _ i 
l«2...ijv t Vi\i2...i N 



.i N 



• / lli2-..ljV 



(39) 
(40) 



«1«2---«JV 



where 



and (|3~9"j) result in 



'll4 2 ...ijV 



are arbitrary functions with (j4*Uj) as a constraint. Eqs. 



Ai+A 2 +...+Ajv 
Pi\ii...iN 



N 



eXp fc , r (E KrPi/ + 0iii 2 ...iiv) 



(41) 



s=l 



In the Tsallis limit Eq. ()41|) can be written as (by using (|22|) and ()23jT 



Ai+Aa+.-.+Ajy 
Pili2...i N 



N . i^T 



l-iV + (g-l)& 1 i a ...i* + £(P 



'-'■■■'A r V^l/) 
S=l 



(42) 



which is equivalent to the Tsallis proposal for the joint probabilities [TU] if 
we choose 

&... iN = (? - 1)0*,...* (43) 
Consider two subsystems A and B where the probabilities of composite 
system and each subsystem are shown in the following table 



A\B 


1 


2 




1 


pA +b 


P^ B 


Pi 


2 


pA +b 


P$ B 


1-pf 




Pi 


1-pf 


1 
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with the following relations 



A+B , A+B 
Pll "r Pl2 


= P A 1 




(44) 


Pi +B +P^ +B 


= rf = l 


-Pi 


(45) 


A+B , A+B 
Pll ' P21 


= P B 1 




(46) 




= P B = 1 


-Pf 


(47) 



and also a constraint (J4~U|) 

Pn +B 0n + Pu +B ^2 + Pi +B 4>2i + P^ B <P22 = (48) 

Using Eq. (jSJ, it is possible to write Eqs. (jjjj) to (jUj) in terms of 
P11P21 0n> 012; 02i and 022- So 0y-s can be determined. For simplicity we use 
Tsallis limit and so (|42jl for the probabilities of the composite system. We 
also assume that both subsystems A and B are equal, namely Pi = pf = P- 
So we have 

V ^ B = + (q - l)0 n - 1]^ (49) 

^ 2 +B = [p^ 1 + (1 - P)^ + (q~ 1)012 - 1]^ (50) 

j4£ b = + + (g- l)0 2 i - l]^ 1 (51) 

p* +B = [2(1 - p)"" 1 + (q- 1)0 22 - 1]^ (52) 
By substituting Eqs. flUJ) to ((H2J) in (JSJ) to P5|i. we obtain i2 = 2 i and so 

[ 2p 9-l + (g - l)0 n - 1]^T + [p?-l + (1 _ p )«-l + (? _ 1)012 _ iJi^T 

= P (53) 

+ (1 _ + (g _ 1)0 12 + [2(1 - p)^ 1 + (g - 1)0 22 - 1]^ 

= 1 - p (54) 

0u[2p«- 1 + (q - 1)0 U - l]^ 1 + 20 12 [p"- 1 + (1 " p)^ 1 + (<7 - 1)012 - 1]^ 
+0 22 [2(1 -p)^ 1 + (g- 1)0 22 - l]^ 1 = (55) 

With a given value of q, above equations can be solved and one may obtain 
0n(p),0i2(p) = 02i (p) and 22 (p). A few typical (q, 0n(l/2), i2 (l/2)) 
points are: 

(0.4, -7.57873, 0.71845), (0.5, -4.20199, 0.62528), (0.6, -2.5339, 0.53573), 
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(0.7, -1.56656, 0.44851), (0.8, -0.94037, 0.35940), (0.9, -0.49032, 0.25676) 
where it should be noted that for p — 1/2 symmetries of equations ensures 
that <ftii (p) = <p22 {p)- We will investigate more numerical estimates for two- 
parameter entropies in another paper. 



4 Extensive entropy in the case of correlated 
subsystems, a constraint approach 

In this section, a new approach is used where the condition ()40|) is entered 
to the entropy as a constraint and then the entropy is maximized . Parallel 
to what is done in [Oj, we introduce the entropy in the composite system as 



s(e a »)=- e p%:x + --- +An mp%:x + --- +An ) (56) 

S=l 1112. ..ijv 



where A(x) is a generalization of the logarithm. We have the constraints 

E Pt£X- +AN = 1 (57) 

^A 1 +A 2 +...+A N T? A 1 +A 2 +...+A t 

iii 2 ...i N 



E Pt^X^ Et^X--- +AN = U (58) 

i 2 ...i N 

V v m+a ' 2+ - +An 6- ■ • = (59) 

i l i 2 ...i N 



For simplicity we use the notation {i} instead of {i^.-An}- Then the 
entropic functional can be introduced as 

m = s(p)-(3'(J2 P{l} -i) -pfepwEw-u) -^'(Em^w) (6°) 

where /?, (3' and f3" are Lagrange multipliers and it has been supposed that 
isn't an explicit function of p^y. If J-"\p] in Eq. (J60)) is stationary for 
variations of the probabilities P{j}, 

F\p] = (61) 



5 P{j} 

one finds 



[P{j}MP{j})} = ~P{E{j} - H - /i>{i>) (62) 



dp {j} 
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where \i = -(3'/ (3 and // = -(3"/ (3. 

Without loss of generality, we can express the probability distribution pj as 

Pm = a£ ( - j( E m ) ( 63 ) 

where a and A are two arbitrary, real and positive constants, and e(x) an 
invertible function that can be a generalization of, and in some limit reduce 
to, the exponential function. If we require that e(x) be the inverse of A(x), 
Eqs. 0S2D and (JB3J) result in 

r PO}A(PO})] = Ae- 1 ^) (64) 



that can be rewritten as P 



So, for A(x) we have 



^[xA(x)] = Ae" 1 ^) (65) 



£• —it 

A(x) = ln k>r (x) = x r — (66) 



and the constants a and A can be expressed in terms of k and r 

y l + r + k' v ; 

_ (1+r _ fc) (^) 

(l + r + ^- fc ^ 1 J 

Eq. (pj)) indicates that by imposing the condition (|5§)). the definition of 
logarithm dose not change and the only thing we must change is the definition 
of probability in the composite system. 

It is useful here to interpret each subsystem separately. By imposing the 
conditions 

E^ s = 1 (69) 

is 

Y.pf;K a = u s (70) 
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For the subsystems, the entropic functional will be 

and by maximizing the entropic functional in the way similar to the case of 
composite system, we obtain 

p ia = a exp fcr ( - y (E is - fi a ) ) (72) 

where fi s = —f3' s /(3 Sl exp fer (x) is inverse function of hik t r(x) and a and A are 

defined in Eqs. flfi7j) and (jBHJ). 

Using (J53)l and (|72^l . Eq. (31) can be written as 

ln&,r[aexp & (--(E {j} - /i - n'<f>^}))\ = ^ ln fc , r [aexp fc ( — ^(^ - /i s ) )] 
A s =i A 

(73) 

Where parameters </){-,} can be used to ensure extensivity of the two- 
parameter entropies. From Eq. (|T3*j) . it is clear that extensivity of entropy 
dose not necessarily ensures extensivity of energy ( For a discussion in the 
case of q-entropy see ^T] ) . In the Boltzmann-Gibbs limit Eq. (J73|) becomes 

N 

P(E {j} -fx- = £ (3 s (E ls - p.) (74) 

8=1 

where only in a special case leads to the extensivity of energy. 



5 Probabilities and effective number of states 

Our motivation for studying such kind of correlations and extensivity of the 
two-parameter entropies of correlated subsystems was the following argument 
by Tsallis [TU1 IT2*] which defines effective number of states. Suppose that the 
probability distribution in phase space is uniform within a volume W and 
also S q is given by 

S q = \n q W (75) 
With the help of q-product [TB] defined as 

x® q y = exp 9 (ln g x + In, y) 

= (x 1 - 11 + y l - q - l) l/l - q (76) 
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it is possible to interpret S q extensive. Supposing that Wa and W B be the 
number of states for subsystems A and B. Equation 

W e A % = W A ® 9 W B (77) 

can be interpreted as a definition for effective number of states for the system 
A + B. Definition (|7U|) ensures that 

In, Wff B = In, W A ® 9 W B = In, W A + In, W B (78) 

Eq. (J7%|) shows extensivity of the entropy (ffHjl . If we suppose 

W Ax = W A 2 = _ = pj/j4.jv = i/ p (79) 

the probability in the composite system will be 

(i/p£itX- +A n = (Vp) ®, (i/p) ®, - ®, (i/p) (so) 

and hence 

p££t + "' +A " = P ®2- q V ®2- 9 -. ®2- q V (81) 

where (jHTj) is obtained from (fKU|) by the properties of q-product. At this 
point it is appropriate to use the following q-product which is used in this 
paper 

x® q ' V = exp g , (ln 9 / x + ln q > y) 

= (x^+^-l) 1 / 9 '- 1 (82) 

comparing Eq. (j82|l with Eq. (fT6|) shows that q' = 2 — q. By our q-product 
Eq. (jHH) can be written as 

vitX'~ +AN =P® q P® q -® q P (83) 
This is a hinting point to define the probability of composite system in terms 
of the probabilities of subsystems by a generalized (k, r)-product. 



6 conclusion 

In this paper, it is shown that two-parameter entropies Sk, r are not in general 
extensive. A formulation is given where by (k, r)-products of subsystem 
probabilities one may obtain joint probabilities involving some functions 
(fihi 2 ...i N - Demanding extensivity of the entropy imposes some constraints 
on 4>i 1 i 2 ...i N ?> and so joint probabilities are identified. We believe this is the 
most general representation for obtaining extensive entropies in the case of 
correlated subsystems. 
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